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Abstract 

We have developed a curved isochron clock (CIC) by modifying the radial isochron clock to 
provide a clean example of the acceleration (deceleration) effect. By analyzing a two-body system of 
coupled CICs, we determined that an unbalanced mutual interaction caused by curved isochron sets 
is the minimum mechanism needed for generating the acceleration (deceleration) effect in coupled 
oscillator systems. From this we can see that the Sakaguchi and Kuramoto (SK) model which is a 
class of non-frustrated mean feild model has an acceleration (deceleration) effect mechanism. To 
study frustrated coupled oscillator systems, we extended the SK model to two oscillator associative 
memory models, one with symmetric and one with asymmetric dilution of coupling, which also have 
the minimum mechanism of the acceleration (deceleration) effect. We theoretically found that the 
Onsager reaction term (ORT), which is unique to frustrated systems, plays an important role in 
the acceleration (deceleration) effect. These two models are ideal for evaluating the effect of the 
ORT because, with the exception of the ORT, they have the same order parameter equations. We 
found that the two models have identical macroscopic properties, except for the acceleration effect 
caused by the ORT. By comparing the results of the two models, we can extract the effect of the 
ORT from only the rotation speeds of the oscillators. 

PACS numbers: 05.45.Xt, 87.18. Sn, 75.10.Nr 
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I. INTRODUCTION 



Coupled oscillators are of intrinsic interest in many branches of physics, chemistry, and 
biology. One class of coupled oscillator systems has a property that by mutual interac- 
tions, the oscillatory frequency of an individual unit is made higher (lower) than its natural 
frequency. This phenomenon is called the "acceleration (deceleration) effect" and is of par- 
ticular interest to researchers in the biological branch of mathematics [|T], 0]. However, we 
still do not have a clear understanding of the acceleration (deceleration) effect; we need to 
clarify the basic mechanism of this effect in coupled oscillator systems. 

In the first part of this paper, we treat general oscillator models coupled weakly by general 
coupling terms according to Ermentrout Q , and we derive one-dimensional phase equations 
from original equations of high-dimensional dynamics. Then, we apply this general method 
to the radial isochron clock (RIC), which has very simple oscillator dynamics on R^, i.e., a 
unit circle stable orbit. Next, we develop a curved isochron clock (CIC) by modifying the 
RIC, and we derive one-dimensional phase equations from coupled CICs. The CIC also has 
a unit circle stable orbit. We demonstrate that the CIC is a very simple model that provides 
a clean example of the acceleration (deceleration) effect caused by diffusion coupling. Our 
analysis shows that the Sakaguchi and Kuramoto (SK) model 0], which is a mean field 
model of coupled oscillators, has the minimum mechanism of the acceleration (deceleration) 
effect deeply related to coupled CICs. The SK model is not frustrated, so we need to study 
how frustrated interactions affect the frequency of oscillator systems. 

In the next part of this paper, we propose a mean field theory that can treat a general 
class of frustrated coupled oscillator systems and use it to clarify the mechanism of the 
acceleration (deceleration) effect in frustrated coupled oscillators. We found that the On- 
sager reaction term (ORT), which describes the effective self-interaction, plays a key role 
in the effect. The ORT is of great importance in obtaining a physical understanding of 
frustrated random systems, because the presence of such an effective self-interaction is one 
of the characteristics that distinguish frustrated and non-frustrated systems of this types. 
For equilibrium systems, we can rigorously evaluate the effect of the ORT by using the 
Thouless-Anderson-Palmer (TAP) framework and/or by using the replica method 0. 
However, we cannot directly apply these systematic methods to non-equilibrium coupled- 
oscillator systems. While we can define a formal Hamiltonian function on such systems. 
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Perez and Ritort demonstrated that the ground states of such a Hamiltonian are not sta- 
tionary states of the dynamics [0. Therefore, it is impossible to construct a theory based on 
free energy for such systems. Consequently, to evaluate the macroscopic quantities in such 
systems that include an ORT, self- consistent signal-to-noise analysis (SCSNA), which can 
be applied to systems without a Hamiltonian function, has been used . The mathematical 
treatment of this method is similar to that of the cavity method 0. Results obtained using 
SCSNA have been consistent with those using the replica method, but this method includes 
a few heuristic steps. While SCSNA has produced some interesting results, they have not 
been sufficient to give a complete understanding of frustrated systems. Consequently, many 
fundamental theoretical questions remain in the study of such systems. In fact, even the 
existence of the type of self-interaction that can be described by the ORT is the subject of 
some debate ||^, |10[ . 



Here, we consider two oscillator associative memory models, one with symmetric and one 
with asymmetric dilution of coupling. These two models use are ideal for evaluating the effect 
of the ORT because, with the exception of the ORT, they have the same order parameter 
equations. The theory we present reveals a non-trivial phenomenon: oscillator rotation in a 
symmetric diluted model is faster (slower) than that in an asymmetric diluted model, even if 
the two models have identical macroscopic properties. Therefore, by comparing the results 
of the two models, we can extract the effect of the ORT from only the rotation speed of the 
oscillators. 

As the random dilution of coupling in associative memory models is equivalent to the 
random coupling noise in the thermodynamic limit, as revealed by previously described 
theories of equilibrium systems 0, 0, [13|, the present model is reduced to one for glass 
oscillators fl^ in the limit of strong dilution. Therefore, the theory we propose covers two 
types of frustrated systems, the oscillator associative memory model and the glass oscillator 
model. Such models are typical frustrated non-equilibrium systems with large degrees of 
freedom. 

In uniformly coupled oscillators, there is a unique stable state, i.e., the ferromagnetic 
state in the phase space. In random systems, there are many stable states in the phase space 
(ferromagnetic phases and glass phases). Our theory describes the mutual entrainment in the 
ferromagnetic phases (memory retrieval), in which most of the oscillators are synchronized by 
the strong mutual interaction. If the memory retrieval process is unsuccessful, the system 
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is in the glass phase (spurious memory retrieval), and in this phase, the system causes 
quasi-entrainment [|14|, which is regarded as weak entrainment compared to that in the 
ferromagnetic phase. Unfortunately, it is difficult to theoretically analyze the glass states 
of non-equilibrium systems because we have not yet developed sufficient theoretical tools to 
capture the complicated structures of the glass state in non-equilibrium systems. Therefore, 
instead of using theoretical analyses, we have numerically studied quasi-entrainment in the 
glass phase We found that the distribution of local fields takes a "volcanic" form in the 



glass phase which implies an outbreak of the ergodicity breaking with the ultrametric 
structure of the glass state related to the replica-symmetry breaking. 

A serious problem with using attractor-type networks for solving optimization problems 
is detecting being trapped in a meta-stable state during the relaxation process. Results 
obtained from analyzing memory retrieval and spurious memory retrieval have shown that it 
is possible to determine whether the retrieval process is successful or not by using information 
about the synchrony/ asynchrony. This means that we can apply non-equilibrium systems 
to optimization problems in order to detect meta-stable states. 

II. PHASE EQUATION 

In this section, we use the method of Ermentrout |^ to derive a phase equation for 
coupled oscillators. First, let us consider the following isolated limit cycle oscillator: 

— = F{x), a;GR", F : R" ^ R". (1) 

We assume this system has a stable periodic solution with period 27r that satisfies 

= = $(t + 27r). (2) 

This equation is autonomous or invariant to shifts in the time domain, so + (p) is also a 
solution for any G R/27r. In other words, the periodic solution is irresistant to a temporal 
shift while it conserves a fixed orbit (neutral stability). This is referred to as "orbit stability" . 
Here, stands for the "phase" of the periodic solution. 
If we modulate the time constant, 

{l-eu)^ = F{x), (3) 
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this system has a periodic solution with period 27r(l — eu), which can be expressed as 

x{t) = $ (-^] , (4) 



^1 — eoo ^ 

where 1 >> £ > 0. When u > 0, the period of this system is shghtly shorter than 27r. 
Next, we consider the high-dimensional dynamics of coupled oscillator systems: 

doc ■ 

(l-eco,)^ = Fix,)+ep„ i = l,---,N, (5) 

TV 

Pi = Yl ^iji^i^^j)^ (6) 
X, e R", V^j : R" X R", (7) 

where Xi is a configuration variable of the i-th oscillator (with a total of oscillators). The 
epj^ is the perturbation, i.e., the coupling term, which is the sum of Vij = 1, ■ ■ ■ , A^) 
representing the interaction from unit j to unit i. If ep^ = 0, each oscillator continues 
rotating on a limit-cycle orbit individually. The euji denotes the fluctuation in the individual 
natural frequency. 

If e is sufficiently small, the components of the perturbation that breaks the shape of 
the orbit are suppressed by the stability of the solution. However, the component of the 
perturbation that shifts the phase cannot be suppressed, causing the phase to move to the 
most "comfortable" position. 

The solution of a perturbed system (|^) can be represented as 

u,{t) = ^{t + (f)i{T)) +eu,{t), T = et, (8) 

where (pi is the phase of the i— th oscillator (with a total of oscillators), r denotes a 
slowly varying time, and eUi is a fluctuation caused by the perturbation. In the following 
derivation, r and (pi are considered to be approximately constant within a period. 

By substituting Eq. (||) into Eq. (|^), expanding a polynomial around e = 0, and 
neglecting the higher order terms, we obtain 



$'(t + 0,(r)) L + (^(t + M^))^ ^(t + U^))) = (9) 

L^^ = ±-DFi^it + (P,)), (10) 
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where is the hnearized operator of Eq. (||) around the periodic solution + 0), and 
DF{^) is a Jacobi matrix of F{^). A hnearized slow dynamics around the periodic solution, 
$(t + 0), is expressed as 

^ = L^u, (11) 

where all of the eigen- values of are non-positive since the solution, $(t + 0), is stable. 
We obtain eigenvalue of with eigenfunction + 0) by differentiating ^ = i^($). 
This eigenfunction corresponds to the minimal temporal shift because $(t + + e) = $(t + 
0) + e*b'{t + 0). We assume there are no other eigenf unctions for eigen- value in the space 
of the periodic function, so, 

kerL^ = span{$'(t + 0)}. (12) 

This assumption is equivalent to that for the orbit stability of $(t + 0i). 
We define an inner product of two n-dimensional 27r-periodic functions as 

{Vi{t),V2{t)) = / dtVi{tfv2{t). (13) 
JQ 

The adjoint operator, L^, of is defined by 

We can explicitly obtain the adjoint operator of L^- as 

L; = -|-DF($(t + 0))^. (14) 

From Fredholm's alternative [Q, there is a that spans a kernel of in the space of the 
periodic function, so 

kerL; = span{$*(t + 0)}. (15) 
Taking the inner product between $*(t -|- 0j) and Eq. (0), we obtain 



$*(t + 0,),$'(t + 0,)) L,-^") + 5^($*(t + 0,),V,,($(t + 0,),$(t + 0,))) 

= (**(t + 0i),L^,n,) 

= (L;^$*(t + 0,),n,> 

= 0. (16) 
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Thus, we derive the following phase equation describing the slow dynamics of the phase- 
locking. 

^ = ^i + Yl ^^i^'^j ~ '^^)' (1'^) 

where Tij{(j)) = Vij $(t + (f)))) / Tij{(j)) is referred to as "cou- 

pling function", and Ui represents the natural frequency of unit i. By using the formal 
multiple-scale perturbation method, we reduce the high-dimensional dynamics of oscillators 
to a low-dimensional representation. 



III. ACCELERATION EFFECT IN DIFFUSIONALLY COUPLED OSCILLATORS 
(TWO-BODY SYSTEM) 

In this section, we treat general oscillator models coupled weakly by diffusional coupling 
terms. The general theory is applied to the radial isochron clock (RIC) and curved isochron 



clock (CIC). Note that RIC and CIC belong to a class of the Stuart-Landau oscillator [jT5 
By analyzing two-body systems of coupled RICs and coupled CICs, we clarify the general 
mechanism of the acceleration (deceleration) effect in coupled oscillator systems. 
We consider a system of two oscillators coupled by weak diffusion: 

;i - ^^i)^ = F{x{) + ea{x^ - x^), ^^^^ 
;i - £CU2)^ = F{X2) + £a(xi - a32), 
where a is the diffusion coefficient representing the coupling strength. 

Based on the analysis in Section II, we can derive the following phase equation describing 
the slow dynamics of phase-locking. 



dr 1^ VV^2 ^^g^ 

f^ = a72 + ar(0i-02), 

where 1(0) = ($*(t), $(t + 0) - $(t)) / ($*(t), $'(t)). 

In the special case, these two oscillators are mutually locked and are accelerated (decel- 
erated) by the effect of diffusional coupling. We term this phenomenon "the acceleration 
(deceleration) effect". We next derive the conditions for it. 

We can express phase-locking solution of Eq. (^) as 

0i(r) = cur + ?7i, 02 (r) = cur + 7^2, V = V2 - Vi, (20) 



where tu, rji, and 772 are constant. When a = 0, the natural periods of the two oscillators 
are and respectively. On the other hand, when the two oscillators are mutually 

locked (cr 7^ 0), their periods are equal to j^^- Here, we assume 

Ui > UJ2. (21) 

This assumption does not lose the generality of our theory. 

To obtain the parameter regions of the acceleration (deceleration) effect, we need to 
define the effect. One definition for the effect is the following. If uj > {uJi + uJi)/2, the 
two oscillators are locked at a speed faster than their mean natural rotation speed. This 
condition is defined as "acceleration". If u; < {ui + uJi)/2, the two oscillators are locked at 
a speed slower than their mean natural rotation speed. This is defined as "deceleration". 
However, in this section, we focus on more a radical situation. 

If > tui, the two oscillators are locked at a speed faster than either of their natural 
rotation speeds. This condition is defined as "acceleration". If u < uj2, the two oscillators 
are locked at a speed slower than either of their natural rotation speeds. This is defined as 
"deceleration". If 002 < uj < ui, the two oscillators are locked at a speed midway between 
their natural rotation speeds. This condition is called the "medium state", and it does 
not belong to the acceleration (deceleration) effect. In the following analyses of two-body 
systems, we use these more radical definitions. 

By substituting Eq. (^) into Eq. (|r^), we obtain 

u = uJi + (rT{7]) =U2 + (rT{~r]). (22) 

We can rewrite Eq. ([2^ ) as 

r(,)-r(-,) = -^^^. (23) 



Consequently, we can graphically obtain rj from Eq. (^) and then obtain u from Eq. (p2D. 
Since, in general, Eq. (|23|) possesses two or more solutions consisting of stable and unstable 
fixed points, the following stability condition must be satisfied: 

aiT'{v) + r'i-v))>0. (24) 

Given Eq. (pi]), we obtain the following conditions for the acceleration (deceleration) effect 
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from Eq. (H). 



crr(?7) > : (acceleration), 



(25) 



crr(— 77) < : (deceleration), 



These conditions imply that mutual couplings between two oscillators are asymmetric; that 
is, r(?7) 7^ r{—ri). Consequently, asymmetric mutual interaction is the essence of the accel- 
eration (deceleration) effect. 

Next, we apply this general theory to two special models: the radial isochron clock (RIC) 
and the curved isochron clock (CIC). In general, limit cycle oscillators have the so-called 
"isochron", which is defined as a set of initial states converging to a oscillatory solution with 
a common phase. 

The RIC is one of the simplest oscillators on R^, which has a unit circle orbit with period 
2tt and isochron sets that are half- lines radiating from the origin (see Figure |l|(a)). RIC is 
expressed in the polar coordinate system as 



We schematically study two-body systems with diffusional coupling; these systems consist 



due to the effect of their diffusional coupling. One is pulled backward from the isochron, 
while the other is pulled forward. As a result, one is decelerated and the other is accelerated 
throughout a period. Thus, the two oscillators are locked at a speed midway between their 
natural rotation speeds. 

Next, we describe our proposed curved isochron clock (CIC), which is defined as 



where a;(l) = 0. The CIC has a unit circle orbit with period 27r and curved isochron sets 
(see Figure [l|(b)). Figure |I|(b) shows that if there is a phase difference, the oscillators are 
pulled forward from the isochron. This happens because the isochrons of the CIC intersect 
non-orthogonally with a limit cycle. Accordingly, the two oscillators can be accelerated 
throughout a period by locking them with a phase difference. Thus, we should be able to 
lock two oscillators at a faster speed than either of their natural rotation speeds. 




(26) 



of a faster and a slower RIC. As shown in Figure |T|(a), the two oscillators pull each other 




(27) 
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This consideration can be applied to the general case of weakly diffusionally coupled 
oscillators. However, in general, the limit cycle and isochron sets are not rotation symmetric, 
so the acceleration (deceleration) effect must be averaged through a period. 

We next derive the coupling function of diffusionally coupled CICs. A solution on the 
unit circle orbit is expressed in the orthogonal coordinate system as follows: 



m = 

In this case, we can explicitly derive ^*{t): 




(28) 



/ — sin t 




' cost \ 








\ cost , 




I sint / 



(29) 



As a result, we obtain the coupling function 

1 



;sin(?7 + /5o) -sin/5o 
cos po 



(30) 



tan 



- < 3o < -. 

2 ' ^ 2 



Here, (3o is derived from the intersection angle between the isochron and the orbit. If (3o = 0, 
Eq. (pOD corresponds to weakly coupled RICs. Consequently, this phase reduction maintains 
the essence of the acceleration (deceleration) effect. We can study the acceleration (decel- 
eration) phenomenon of diffusionally coupled CICs by analyzing Eq. (pOf). The parameter 
regions of the acceleration (deceleration) effect, which are obtained from the conditions 
defined by Eqs. (|2|), (|2|), and (H) are as follows. 
If a > 0, 



sm T] 



UJi — UJ2 

2a '■ 



-7r/2 < < 0, 



If a < 0, 



— I < /3o < ^ (acceleration) 
^ < /So < f (deceleration) 



UJi — UJ2 ,„ 

smr] = , n/ 2 < 7] < 71, 

2a 

< /So < f (acceleration) 

-| < /3o < (deceleration) 



(31) 



(32) 
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Isochron 



FIG. 1: (a) Schematic diagram of two diffusionally coupled RICs and (b) of two diffusionally 
coupled CICs. 

Figure ^ shows a phase diagram of the acceleration (deceleration) effect of two diffusionally 
coupled CICs. 

Sakaguchi and Kuramoto proposed a mean field model (the SK model) of coupled oscil- 
lators 0. The acceleration (deceleration) effect is also observed in the SK model from the 
point of view of our proposed theory. The SK model is expressed by 

^ = + sin(0j - 0i + po), (33) 

where (pi is the phase of the i—th oscillator (with a total of oscillators), and Ui represents 
its natural frequency. The quantity J represents the strength of the mutual coupling. The 
quantity Po in Eq. (^) represents a uniform bias. Since Eq. ( |5BD can be interpreted as a 
system of weakly coupled CICs, f3o represents the intersection angle between the isochron 
and the orbit, as described above. Due to the effect of the bias caused by the curved isochron 
sets, the mutual interaction between a pair of oscillators is asymmetric. Such an unbalanced 
mutual interaction is the mechanism of the acceleration (deceleration) effect. Therefore, 
we can conclude that the SK model has the minimum mechanisms for the acceleration 
(deceleration) effect related to curved isochron sets. As the SK model is not frustrated, we 
need to study frustrated coupled oscillator systems. 
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FIG. 2: Parameter region of acceleration (deceleration) effect of two diffusionally coupled CICs. 



IV. FRUSTRATED COUPLED OSCILLATOR SYSTEMS 



In this section, we extend the SK model to frustrated coupled oscillator systems with 
large degrees of freedom and describe the mechanism of the acceleration (deceleration) effect 
unique to frustrated coupled oscillators. 

In general, frustrated systems differ from ferromagnetic ones in that they have the On- 
sager reaction term (ORT). Here, we focus on the effect of the ORT on the acceleration 
(deceleration) that exists only in frustrated globally coupled oscillator systems, and in par- 
ticular cannot be found in equilibrium systems. To make this effect clear, it would be best 
to compare two frustrated systems that, with the exception of a different quantity of the 
ORT, have the same order parameter equations. In addition, these systems should have a 
clear correspondence with an equilibrium system because the effects of the ORT are well 
understood in equilibrium systems. 

We thus consider a system with the following form to be ideal. 

N 

Jij sin(</)j -(t)i + Pij + Po) , (34) 



d(f)i 
dr 



This simple phase equation was obtained by approximating rjj(0) in Eq. (|17D to the lowest 
frequency component. In fact, such systems are commonly used as models of coupled oscil- 
lator systems [0, |16|, |l^ |18]. Natural frequencies {uJi}i=i^... in Eq. (|3^) are randomly 
distributed with a density represented by g{uj). Also in Eq. (0), Jij, and Pij denote the 
amplitude of coupling from unit j to unit i and its delay, respectively. In the present study, 
we have selected the following two generalized Hebb learning rules with random dilutions 
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p 

Ci 



\% to determine Jij and (3if 

K,, = J.,exp(zA,) = ^E^'^i' (35) 
= exp(z^r), (36) 

{1 with probability c 
(37) 
with probabihty 1 — c 

where ~ means the complex conjugate. The {6*^^ }j=i^... ,Ar,;i=i,... ,p are the phase patterns to be 
stored in the present model and are assigned to random numbers with a uniform probability 
on the interval [0, 2tt]. The /i is an index of the stored pattern, and p is the total number of 
stored patterns. We define parameter a (the loading rate) by a = p/N. When a ~ 0(1), 
the system is frustrated. When a = 0, the system is equivalent to the SK model. The 
quantity is the dilution coefficient. Let Cij = 1 if there is non-zero coupling from unit j 
to unit i and Cij = otherwise. The number of fan- ins (fan-outs) is restricted to 0{N), i.e., 
c~0(l). 

Here, we consider both symmetric dilution (i.e., Cij = Cji) and asymmetric dilution (i.e., 
Cij and Cji are independent random variables) |jl3[ • The quantity Pq in Eq. ( 13^) represents 



a uniform bias. Since Eq. (|3^) can be interpreted as a system of weakly coupled CICs, 
Po represents the intersection angle between the isochron and the orbit, as discussed in 
Section III. Due to the effect of the bias caused by the curved isochron sets, the mutual 
interaction between a pair of oscillators is asymmetric, even if J^j — ^ji and jSij — — Pji- 
Such an unbalanced mutual interaction is the essence of the acceleration (deceleration) 
effect, because oscillators are pulled forward from the isochron, as discussed in Section III. 
If /5o = 0, Eq. (|34|) is equivalent to weakly coupled RICs. 

There is a close analogy between the phase description of coupled oscillators and the 
classical XY-spin model of magnetic material. If cuj = 0, /5o = 0, Jij = Jji, and Pij = —Pji, 
we can define the following Lyapnov function on the system: 



N 

I , 

E 



1 ^ 

-^JijCos{(l)j - (l)i + Pij). (38) 



2 



This function enables us to use conventional statistical mechanics for XY-spin systems 

to analyze coupled oscillators in the equilibrium state. Thus, this system can be mapped 



to an XY-spin system |12, 19 1. In this way, we can make a bridge between the frustrated 



coupled oscillator system and the equilibrium system. 
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V. ORDER PARAMETER EQUATIONS 



Let us consider steady states of the system in the hmit r — * oo. Our theory is based on 
the condition that there is one large cluster of oscillators synchronously locked at frequency 
Q and the number of this cluster scales as ~ 0{N). Under this condition, Daido demon- 
strated, through a scaling plot obtained from numerical simulation, that variation in the 
parameter order scales as 0(l/-\/iV) in ferromagnetic systems with one large synchronous 
cluster We thus assume that the self-averaging property holds in our system and that 
the order parameters are constant in the limit N oo. These assumptions were also used 
by Sakaguchi and Kuramoto |Q. 

Redefining 0j according to (pi ^ (pi + Qr and substituting this into Eq. (@), we obtain 



- -^ + Ui-n = sin(0i)/if - cos(0,)/i[. (39) 
dr 

where hi represents the so-called "local field", which is described as 

TV 

hi = hf + ihl = e'^« ^H^^i = 

' V 1 P ^ _ \ 

E e-'^ + ^ E E - , (40) 

For convenience, we write Sj = exp(z0i). The order parameter m^, which is the overlap 
between the system state {si}j=i^..._Ar and embedded pattern {4'^}j=i,... ^at, is defined as 



In the thermodynamic limit, the effect of the second term of Eq. (^OD, i.e. 
;^ "Hr"^i'^i '^i' equivalent to that of the effect of additive coupling noise 

1 ^ 

Ki, = J,, exp(^A,) = ]7 E ^'^^'j + ^""^^ (42) 

ReSriij ^^{0,uyN), (43) 

Imdriij Af{0,iyyN), (44) 



2 



a{l — c) 
2^ 



(45) 
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where u'^/N is the variance of additive couphng noise Sriij. In the case of symmetric dilution, 



6nij is symmetric, i.e., 6nij = 6nji. On the other hand, in the case of asymmetric dilution, 
6nij and 6nji are independent random variables. In the limit of strong dilution, i.e. c — > 0, 
with a/c kept finite, our system is reduced to a glass oscillator, which corresponds to the 



Sherrington-Kirkpatrick model of spin glass [21]. Therefore, our theory can cover two types 



of frustrated systems, the oscillator associative memory system and the glass oscillator 
system. 

In general, the fields hf and /i[ involve the ORT corresponding to the effective self- 
feedback P] . We must eliminate the ORT from these fields. Here, we assume that the local 
field sphts into a "pure" effective local field, hi = hf + ihj, and the ORT, Fs,: 

hi = hi + Tsi. (46) 

We neglect the complex conjugate term of the ORT, which leads to a higher-harmonic 
term of the coupling function ||2^. This can be done in the present model because we use 
generalized Hebb learning rules (see Appendix). Hence, by substituting Eq. (^6]) into Eq. 
(^), we obtain 

-^ + uj^-Cl = sm{(f)i)hf - cos{(f)i)hl, (47) 
= ^] - |r|sin(V^), ^ = Arg(r), (48) 

which does not contain the ORT. The quantity Q represents the effective frequency of the 
synchronous oscillators. We can regard Q as the renormalized version of Q, from which the 
ORT has been removed, so Q takes a different value from the observable Q in general. Thus, 
r2 — represents the contribution of the ORT to the acceleration (deceleration) effect; Cl is 
one of the order parameters of our theory. In the analysis that follows, hi and F are obtained 
in a self-consistent manner (see Appendix). 

Let us consider synchronous oscillators in which ^ = is satisfied in Eq. (0). As a 
result, the stationary states of the oscillators are satisfied: 



h- - 9) + \ \hi\'^ - {uji - 9) 



(49) 



\hi\ \hi\ 
From Eq. (^9]), we obtain the following condition for synchronization: 

> {oji - . (50) 

15 



If hi does not satisfy Eq. ([50|), (f)i continues rotating individually (i.e., desynchronization). 
This condition corresponds to Eq. (pSf ) for two coupled oscillators. We assume that the 
microscopic memory effect can be neglected in the r —>■ oo limit. In other words, the 
asymptotic state of the system as r — > oo is assumed to be independent of the initial 
conditions at r = 0. This assumption is exact in non- frustrated systems Under this 

assumption, (pi takes the following form: 

(pi = U^iT + /{u^iT). (51) 

where f{x) is a periodic function with period 2tt, and uji is the resultant frequency of 
asynchronous oscillators into which the ORT has been absorbed. a)j is given by the following 
equation: 



u, = n + {CO, - - (52) 

[uji - iiy 



Applying the SK theory 0] to Eq. (^Tf), we obtain the average of Si over cu,: 

f7r/2 



Si)^ = hi d(pg (n + \hi\ sin (pj COS (pexp{i(, 



+ ih, r'\^ ^^(^-^4') \L^M\.J 0„,<,, _ Jk I ^ . (53) 

Jo sm'^^ 1 \ sm(p I \ smr^ ' ' 

In this analysis, we focus on the memory retrieval states in which the configuration has 
appreciable overlap with the condensed pattern (m^ ~ 0(1)) and has little overlap with 
the uncondensed patterns ^'^ for yU > 1 (m'^ ~ 0(1/ \^)). Under this assumption, we 
obtain the contribution of the uncondensed patterns using SCSNA (self-consistent signal to 
noise analysis) and determine hi in a self-consistent manner (see Appendix). Finally, the 
equations relating the order parameters \m^\, U, and Cl are obtained using the self-consistent 
local field: 

= //x{xi,X2;n))) , (54) 



Xl,X2 



JJ^-^^o = Fi(xi,a:2;fi))) , (55) 



Xl,X2 



where ((■ ■ ■ ))^.^ is the Gaussian average over xi and X2, {{■ ■ ■ = J f DxiDx2 ■ ■ ■ ■ 

The quantity U corresponds to the susceptibility, which is the measure of the sensitivity to 
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external fields. Since the present system possesses rotational symmetry with respect to the 
phase (pi, we can safely set the condensed pattern to Q = 1. Now, h, X, Fi, and DxiDx2 
can be expressed as 

-.-.^^e..p(-£!^), (56, 

9 2 2 afl — c) r I ii • f^r,\ 

= 2|i-[/|2 ' 2c ' ^= 1"^ l+^i+^^2, (57) 

r-7r/2 



X(xi,X2;fi) = h (i05f (fi + |/;,| sin0 j cos0exp(z<; 



'-it/2 

•I J. COS 0(1 -COS 0) f \h\\ f~ \h\ 

sm (h \ \ sm / \ sm ( 







Fi(xi,X2;fi) = J c?0 ^fi + sin0j + -U- sin0(7' ^fi + sin0j j cos0exp(i<; 



/ c?0 ^\ 3 ^ <( (7 I fi + 1 - (7 I fi ' ' 







sm fi) \ sm / \ sm I 



I r'^ ,, co.,(i - cos,) f , ^ JM^ V ^, . IL 

/ ./n sm \ sm0 / \ smri 





The terms with the coefficient i in Eqs. ( |5BD and (^) represent the contribution of asyn- 
chronous oscillators to the macroscopic behavior. The other terms represent the contribution 
of the cluster of synchronous oscillators. In the case of the symmetric diluted system, F can 
be expressed as 

re-^o = ^ + ^il^t/. (60) 
1 — U c 

In the case of the asymmetric diluted system, on the other hand, we have 

re-^o = (61) 

h and fi are the renormalized versions of h and fi, respectively, from which the ORT has 
been removed, and thus h and fi are independent of the ORT. Therefore, the two models 
we consider have identical order parameter equations, (|5^) and (|55|) , written using the term 
of the renormalized quantities h and fi. From Eq. (|48|) , the difference between the ORTs 
in Eqs. (^) and ( |6TD leads to a different value for the observable fi only when /3o 7^ 0. In 
this way we are able to clearly separate the effect of the ORT, and therefore, by observing 
the macroscopic parameter fi of these two systems, we can analyze the effect of the ORT 
qualitatively and quantitatively. 
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The distribution of renormalized resultant frequencies uj (Eq. (|52D) in the memory re- 
trieval state, which is denoted as p{Cj), becomes 



P{Co) = r6{u I DxiDx2^ \ "^'^ , (62) 

r = y DxiDx2\h\ J dcpg (^^l + \h\ sin (pj cos (p, (63) 

The (5-function in Eq. ( p^ ) indicates the cluster of oscillators synchronously locked at fre- 
quency Cl. The value r is the ratio between the number of synchronous oscillators and the 
total number of oscillators N. The second term in Eq. (|64|) represents the distribution 
of asynchronous oscillators. From the distribution given by Eq. (|62|) , the distribution of 
observable resultant frequencies ZJ, which is denoted as pip), becomes 

p{uJ) = p (uJ - (n - n)) . (64) 



We now consider the relationships between the present theory and previously proposed 
theories. If Pq = and g^uj) are symmetric, our theory reduces to the theory proposed by 
Aonishi et al. 0: 

X{xi,X2;^) = h J dxg (^\h\x^ Vl — x"^, (65) 

Fi(xi,X2;f2) = J dx ^ + '^^5'' (l^l^)^ Vl — x^. (66) 

where Q = Q = 0, since Fi and U are real numbers. If g{uj) = 6{uj), = 0, and Cij = Cji, 
where the present model reduces to an XY-spin system, we obtain 

\n\ 2\n\ 

which coincide with the replica theory of Cook [T^ and SCSNA [^]. In addition, in the 
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uniform-system limit, a — 0, our theory reproduces the SK theory 

»7r/2 



/ d<\)g ( + \vn}' I sin j cos <\) exp(i<j 



'■it/2 

• I ii r^"^ , , cos</)(l — COS0) f / ~ |m^|\ f~ \m^\ . . 

sm'^f/) \ smffl/ V smi ' ' 







1+ 



((U-n)2 

7r/2 

(i05f (i7 + Im"*^ I sin 0) cos 0, (70) 

■7r/2 

h = Vl. (71) 

In the hmit N —>■ oo, models with random dilution are equivalent to models with additive 
coupling noise |jTT|, |12|, 0. In the limit c — with a/c kept finite, our system is equivalent 



to a glass oscillator system with complex interaction. The equations relating the order 
parameters \m^\ and fl are 

= //x(xi,X2;f2))) , (72) 

\ \ / / Xl,X2 



dxidx2 ( X? + 



DxiDx2 = — — 5-exp — -— , (73) 



2 2 
p =U 



a 

"71/2 



h = \m^ \ + xi + ix2, (74) 



X(xi, X2;^) = h / d(f)g i^l + \h\ sin (pj cos (J) exp{i(l)) 



JO sm I \ sm(/) / \ sm 

The above order parameter equations do not contain susceptibility \J . 

VI. SIMULATION 

A. Acceleration (deceleration) effect 

In the numerical simulations we now discuss, we set the distribution of natural frequencies 



as 



g{uj) = (27ra2)-i/2 exp{-u;y2a^), (76) 
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and we used the Euler scheme with a time increment of 0.1, which gave a sufficiently good 
approximation compared to that of smaller time increments. The resultant frequencies uJi 
were calculated using a long time average of d(j)i/dT. The acceleration (deceleration) effect 
was defined as folows: one large cluster of oscillators are synchronously locked at a faster 
(slower) speed than the mean natural rotation speed of all the oscillators. 

First, we set [3q = 7r/20, c = 1.0 (i.e., no dilution), and a = 0.2. Figure ^(a) shows |m^| 
as a function of a, and Fig. |^(b) shows Q and Cl as functions of a in the memory states. 
The solid curves were obtained theoretically, and the data points with error bars represent 
results obtained by numerical simulation. As previously discussed, the ORT was removed 
from Q, so the value of Q differed from that of the observable Q. The gap between Q and fl 
in Figure ^(b) is in proportion to the absolute value of the ORT, as described in Eq. (^8|). 
Thus, increasing loading rate a tended to accelerate all of the oscillators due to the effect 
of the ORT. Figure |^(c) shows Q as a function of a in the spurious memory states, where 
Q corresponds to the maximum point of a histogram of uJi. Compared to Fig. |^(b), the 
profile of the curve in Fig. ^(c) is different from that of the memory states. This is a very 
important phenomenon in the context of engineering because, from the results shown in 
Figs. 0(b) and (c), we can determine if the recall process is successful or not by estimating 
the difference in the rotation speeds of the oscillators. Figure |^(d) shows histograms of the 
resultant frequencies oJj in the memory and spurious memory states, which were obtained by 
numerical simulation [a = 0.022). In this graph, we shifted the center of the peak to and 
superimposed the solid curves obtained theoretically for the memory states. The theoretical 
memory-state results are in good agreement with the simulation ones. 

Next, to make conffim that the acceleration (deceleration) effect is caused by the ORT, 
we analyzed oscillator associative memory models involving two types of diluted couplings. 
We set a = 0.2, Pq = it/20, and c = 0.5. Figure ^(a) shows f2 as a function of a in 
the memory retrieval states; the solid curves were obtained theoretically, and the data 
points with error bars represent results obtained by numerical simulation. It shows that the 
oscillator rotated faster in the symmetric diluted system than in the asymmetric one. As 
previously discussed, Cl in Fig. §(a), which represents the effective frequency of synchronous 
oscillators, does not depend on the type of dilution, while the observed Q strongly depended 
on it. This dependence was due to the existence of the ORT. If local field h does not contain 
the ORT |Ty] , plots obtained from numerical simulations of both models should fit the curve 
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FIG. 3: Simulated and theoretical results when /3o = vr/20, a = 0.2, c = 1.0, N = 20000. Solid 
curves were theoretically obtained; plots were obtained by numerical simulation, (a) \m^\ as a 
function of a. (b) as a function of a in memory states, (c) as a function of a in spurious 
memory states. To compare in spurious memory states with that in the memory states, we 
superimposed theoretical 0, in the memory states, (d) Distribution of resultant frequencies ZJi in 
memory and spurious memory states, a = 0.022. The center of the delta peak shifted to 0. 



of Q. Therefore, the dependence of the observed Q on the type of dilution is strong evidence 
for the existence of the ORT in the present system. In this figure, we shifted the numerical 
values of f2 at a = (in the computer simulation) to their corresponding theoretical values 
at a = in order to cancel fluctuations in the mean value of g{uj) caused by the finite-size 
effect. 

Figures §(b) and (c) show the distributions of the resultant frequencies for the symmetric 
and asymmetric dilution systems, respectively. The theoretical results (solid curve) are 
in good agreement with the simulated one (histogram). From the results given in Figs, 
^(b) and (c), the distribution of the resultant frequencies for the symmetric diluted system 
is identical to that for the asymmetric diluted system, except for differences in positions 
caused by the ORT. We thus conclude that the mean field, h, of the symmetric diluted 
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FIG. 4: Difference between symmetric and asymmetric dilution systems; = 10,000, a = 0.2, 
Po = vr/20, and c = 0.5. (a) 17 as a function of a. (b) Distribution of resultant frequencies for 
symmetric dilution system (a = 0.02). (c) Distribution of resultant frequencies for asymmetric 
dilution system (a = 0.02). 

system is identical to that of the asymmetric diluted system, since h reflects the distribution 
of resultant frequencies, as represented by Eq. (|64|). Figures |(a) and (b) show |m^| as a 
function of a for the symmetric and asymmetric diluted systems, respectively. The solid 
curves were obtained theoretically, and the data plots represent the results obtained from 
numerical simulations. As the figures show, the critical memory capacities of the two models 
are equal. 

Consequently, symmetric and asymmetric diluted systems have the same macroscopic 
properties, with the exception of the acceleration (deceleration) effect caused by the ORT. 
The quantity of the ORT depends on the type of dilution, and this dependence leads to a 
difference in the rotation speeds of the oscillators for the two cases, as shown in Fig. ^(a). 
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FIG. 5: \m^\ as a function of a. Solid curves were obtained theoretically, and data points were 
obtained by numerical simulation; N = 10,000, a = 0.2, Pq = it/20, and c = 0.5. (a) Symmetric 
dilution system, (b) Asymmetric dilution system. 

B. Glass oscillators 

In the numerical simulations described here, we used a random symmetric coupling system 
instead of the symmetric diluted system. We randomly chose those couplings using two 
probability functions: Jij cos{(3ij) ~ U^i/N, u'^/N) and Jij sin{j3ij) ~ f/{l/N, i^'^/N), where 
we restrict mutual couplings to symmetric ones, Jij exp(i/5jj) = Jji exp(— and set Pq = 0. 
Figure ^ shows a phase diagram in the a, v) space, which was obtained by numerically 

solving the order parameter equation ([7^). A cross-section of this curved surface at z/ = 
is equal to a result of the SK theory ||^. Figures 0(a), (b), (c), and (d) display \rn}\ as a 
function of a for various values of z/; the solid curves were obtained theoretically, and the 
data points show results obtained by numerical simulation. Figures |](a) and (b) show the 
distributions of the resultant frequencies tJj in the ferromagnetic state. As Figs. |^ and |^ 
reveal, when \m^\ was small, the theoretical curves did not fit the simulation results very 
well. We surmise that the gap between the simulation results and theoretical results might 
have been caused by the ergodicity breaking with the ultrametric structure of the glass 



states; this breaking is related to replica-symmetry breaking [^, |2g]. Unfortunately, our 
theory does not capture the ultrametric structure of the glass states; it focuses only on one 
of the pure states in the phase space. In the next section, we will explain the glass phase in 
detail. 
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FIG. 6: Phase diagram in (Im^l, a, u) space (/3o = 0) of spin glass model. 




FIG. 7: \m^\ as a function of a (solid curves were theoretically obtained; plots were obtained by 
numerical simulation). Pq = 0, N = 2000. 

C. Properties of spurious memory state 

Here, we examine the properties of spurious memory states. In the following analyses, 
we set c = 0.5, a = 0.025, cr = 0.16, and /?o = 0. 

Figures ^ (a), (a'), (b), and (b') show histograms of resultant frequencies ZJi in memory 
states and superimpose histograms of ZJi in spurious memory states. Figures ^ (b) and (b') 
show in detail the structures of the sharp peaks at the center cJ = in Figs. |^ (a) and (a'), 
respectively. Figures || (a) and (b) correspond to the cases of asymmetric diluted systems, 
and Figs. | (a') and (b') correspond to the cases of symmetric diluted systems. 

As shown in Figs. |^ (a) and (a'), in memory retrieval states, a single delta-peak exists 
at cJ = 0, which corresponds to a large cluster of synchronous oscillators, and asynchronous 
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(a) 

FIG. 8: Distribution of resultant frequencies uJi in ferromagnetic states, (a) v = 0.15, a = 0.36, 
f3o = 0. (b) 1/ = 0.45, a = 0.28, /3o = 0. 

oscillators are symmetrically distributed around the delta-peak. 

On the other hand, as shown in Figs. § (a) and (a'), in spurious memory states, a sharp 
peak exists at cJ = 0. As Figs. |^ (b) and (b') reveal, the peak of the spurious memory states 
at ZJ = is gentler than that of the memory retrieval states. These gentle peak indicates 
that the entrainment in the glass phase is weaker than that in the ferromagnetic phase. This 
phenomenon corresponds to the so-called quasi- entrainment observed in the glass oscillator 



system As shown in Figs. |^ (a) and (a'), the degree of asynchronous oscillators in the 
spurious memory states is larger than that in the memory states. As the results obtained 
from analyses of the system in the memory and spurious memory states reveal, we can 
determine if the recall process is successful or not by using information about the degrees of 
the synchronous oscillators. Note that it is difficult for attractor-type networks used to solve 
optimization problems to detect being trapped in a meta-stable state during the relaxation 
process. This new finding indicates that a class of non-equilibrium systems can potentially 
be used to address the detection of meta-stable states. 

Figures |l^(a), (b), (c), and (d) show histograms of the absolute value of local field \h\ 
in the memory and spurious memory states. Since the present system possesses rotational 
symmetry with respect to the phase (pi, we can safely define the condensed pattern as = 1; 
i.e., the gauge transformation can be performed on variables of the condensed pattern. After 
the gauge transformation, if the system is in the memory states, the histogram of local field 
h is given as a two-dimensional isotropic Gaussian at h = iv} in the complex plane. However, 
the histogram of h in the spurious memory state takes a "volcanic" form around h = {] m 
the complex plane. Such a histogram form for the local field was also observed in the glass 



oscillator system It is well-known that in equilibrium systems, the spin glass states 

have an ultrametric tree structure [^4|, This structure of the spin glass states can be 
expressed using the replica symmetric breaking scheme in replica theory, which is based on 
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FIG. 9: Distribution of resultant frequencies Ui in memory and spurious memory states. c = 0.5, 
a = 0.025, a = 0.16, and /?o = 0; (b) and (b') show in detail the structure of the sharp peaks at 
the center cJ = of ^ in (a) and (a'), respectively, (a) and (b) asymmetry dilution; (a') and (b') 
symmetry dilution. 

a mult i- cascade Gaussian process for generating the local field [^. We surmise that even 
in the non-equilibrium systems proposed here, a multi-cascade Gaussian process in the glass 
states results in a non-Gaussian distribution of the local field, as shown in Figs. |l3(a), (b), 
(c), and (d). 

As mentioned above, our theory does not capture the ultrametric structure of the glass 
states; it focuses only on one of the pure states in the phase space. This is because SCSNA is 
based on the Gaussian ansatz for the local field, which is deeply related to replica symmetric 
approximation in replica theory |p. Even in the spurious memory state, SCSNA and replica 
theory under replica symmetric approximation give the probability distribution of the local 
field as a single Gaussian at /i = in the complex plane. However, no one has been able to 
explain the ultrametric structure of the glass states in the SCSNA framework. Therefore, to 
properly analyze the systems in spurious states (glass states), we need to extend the present 
theory to a more general theory, one that treats an ultrametric structure. 



VII. CONCLUSION 



We have proposed a curved isochron clock (CIC) based on the radial isochron clock that 
provides a clean example of the acceleration (deceleration) effect. By analyzing two-body 
system of coupled CICs, we showed that an unbalanced mutual interaction caused by curved 
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FIG. 10: Distribution of local field in memory and spurious memory states. /3o = 0. (a) and (b) 
show results of numerical simulation for systems with symmetry dilution; (c) and (d) show those 
of systems with asymmetry dilution. 

isochron sets is the minimum mechanism needed for generating the acceleration (decelera- 
tion) effect in coupled oscillator systems. From this we determined that the Sakaguchi and 
Kuramoto (SK) model, which is a mean field model of coupled oscillators without frustra- 
tion, has such a mechanism. To study frustrated coupled oscillator systems, we extend the 
SK model to two oscillator associative memory models, one with symmetric and one with 
asymmetric dilution of coupling, which also have the minimum mechanism for the accelera- 
tion (deceleration) effect. We theoretically showed that the Onsager reaction term (ORT), 
which is unique to frustrated systems, plays an important role in the acceleration (deceler- 
ation) effect. Comparing the two models, we extracted the effect of the ORT only to the 
rotation speed of the oscillators. 

The acceleration (deceleration) effect caused by the ORT is peculiar to non-equilibrium 
systems, since this effect only occurs when (3^ ^ 0. There has been fundamental disagreement 
regarding the existence of the ORT in a typical system corresponding to our model with 
/3o = and a symmetric (7(0;) P, ffOj. From the results of this work we conclude that even if 
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/^o = and g{uj) is symmetric, the ORT exists in the bare local field given by Eq. (|40|). In 
this case, the effect of the ORT is not detectable because it cancels out of Eq. (^Tf). 

As the results illustrated in Figs |^(a) and (b) reveal, the critical memory capacity of the 
asymmetric diluted systems obtained from numerical simulation is slightly smaller than that 
of the symmetric ones, because asymmetric dilution breaks the detailed balance of the sys- 
tem, which weakens the stability of the memory states. There is yet no theory to rigorously 
treat a system with asymmetric interaction. Most theoretical studies of asymmetric systems 
are based on the naive assumption that there are such steady states as equilibrium states of 
symmetric systems [|l^ . 



In the field of neuroscience, a growing number of researchers are becoming interested in 
the synchrony of oscillatory neural activities because physiological evidence of their existence 
has been obtained in the visual cortex of a cat ^7_, Much experimental and theoretical 



research has been done on the functional role of synchronization. One of the more interesting 
hypotheses is called synchronized population coding, which was proposed by Phillips and 
Singer However, its validity is highly controversial. In this paper, we numerically 

showed the possibility of determining if the recall process was successful or not by using 
information about the synchrony/asynchrony. If we consider information processing in brain 
systems, the solvable toy model presented in this paper may be a good candidate for showing 
the validity of a synchronized population coding in the brain. According to anatomical and 
physiological data, the olfactory system can be considered as an associative memory with 
oscillatory behavior. There is one particularly interesting finding related to our studies. 
Freeman and Sharda demonstrated chaotic behavior of olfactory neural systems in response 
to unknown odors [Q. We suspect that this chaotic behavior is related to the asynchronous 



behavior of our systems in spurious memory states. Thus, the present analysis should 
strongly affect the debate on the functional role of synchrony. 

Appendix: Derivation of order parameter equations 

Assuming a pure effective local field, hi, in Eq. (^61) , we performed renormalization of 



the local field expressed in Eq. (^Tf) . The quantity in Eq. (^) is the renormalized version 
of Q, from which the ORT has been removed. Thus, hi is independent of any macroscopic 
configuration of unit i. In this way, by performing renormalization of the local field, we can 
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reduce large population systems to one-body problems. Under the assumption formalized 
in Eq. (^Bf), the distribution of Sj, which is denoted as n(0i; hi, Q), can be formally derived 
using SK theory. 

In the framework of the SK theory, we can split the distribution of Sj into a synchronized 
part and a desynchronized part as n{(j)i; hi, Q) = ns{(f)i; hi, Cl) + n^s{(f)i; hi, Cl). hi, Cl) 

represents the distribution of synchronous oscillators and nds{(pi', hi,Q) denotes the distri- 
bution of asynchronous ones. First, we derive ns{(j)i;hi,il) from Eq. (^) = 0) as 
follows. 



n^(0i; hi, f2) = y dujig{uji)6 {^Ui - Q - sin(0i)/if + cos(0i)/if^ 

= g(n + hf sin(0i) - hi cos(0,)) {hf cos(0i) + hi sin(0i)) , (77) 

-- + tan-^^<0,<- + tan-^^. 

Next, we consider n(is{<pi'-, hi, Vl, Ui) which represents a conditional probability distribution of 
nds{4>i'^ hi, nds{4>i', hi, Q, Ui) is governed by the following Liouville equation, 

Q ~ ^ () / ~ ~ ~ ~ ^ \ 

-^nds{<Pi] hi, VL, LUi) = -— {^{uji - n- sin(0i)/if + cos(0i)/i[)nrf,(0i; hi, fi, uJi)j . (78) 

In the limit that r — > oo, the stationary distribution becomes 



nds{4>i;hi,Q,uJi) = C{uJi - Q - sm{(j)i)hf' + cos{(j)i)hl) ^ 

,R , ..... .11.-1 





C = 1/ d(f)i{LJ, - n - sm{(f)i)hf + cos{(f)i)hly 



1-—^^- (79) 



27r y (uj, - Q) 

Then, nds{(pi', hi, Q) is expressed as 

1 r i^i - ^) a/ 1 



'nds{(l>uhi,VL) = — / duJig{uJi) - (80) 

27r J \uj,-n\>\h,\ uOi — Vt — sin(0)/if + cos(0i)/if 

Averaging Si over oji, that is, (sj)^. = / d(f)in{(j)i; hi,Q) exp^icpi), we obtain the following 
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equation, 

f.7r/2 



Si{hi)\ = hi f d(j)ig (q + \hi\ sin (pi) cos (f)iexp{i(, 

' '^i J-n/2 ^ ^ 



+ I dujig{uji){uji — f2) ( 1 — \ 1 LiL — 

\hi\ J \co,-Q\>\h,\ \ V (uJi-^)'^ 

~ r'^ (~ ~ \ 

= hi d(j)ig {Vt+ sin 0j j cos 0j exp(20j) 

Jo sm'^^i y sm^^y y sin0i ' 

Note that if gi^l + x) = gi^l — x), we can neglect the effect of asynchronous oscillators. 
When g{x) = 6{x) and Po = 0, we obtain 

s,ik)) = (82) 
' \hi\ 

Next, we estimate hi in the framework of SCSNA. In this analysis, we focus on the mem- 
ory retrieval states, in which the configuration has appreciable overlap with the condensed 
pattern (m^ ~ ^^(1)) has little overlap with the uncondensed patterns ^'^ for fi > 1 
(m^ ~ 0(1/ \^)). Under this assumption, we estimate the contribution of the uncondensed 
patterns using SCSNA P and determine hi in a self-consistent manner. In the first step of 
SCSNA, we split local field hi into a signal part (the first term), a cross-talk noise part (the 
second term), and a coupling noise part (the third term): 

N 

hie-""" = ilw} + i^m^' + 6n,jSj - asi. (83) 

In the next step, we split the cross-talk noise (the second term) and the coupling noise (the 
third term), respectively, into the Gaussian random variable and the ORT. Equation (|39D 
implies that Si is a function of local field hi, natural frequency Ui — Q, and time r; that is, 

Si = X{hi,uJi-n,T). (84) 

Note that Si is not a function of renormalized hi and Q; instead, it is a function of the bare 



hi and f2 in Eq. (|5D|). We can properly evaluate the ORT with this careful treatment. Here, 
we assume that the microscopic memory effect can be neglected in the r ^ oo limit. In 
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general, X{hi, Ui — Q, r) is not regular. As such, a variation in X due to a small perturbation 
in local field h denoted dh is satisfied 



dX = u{h, uj — Q, T)dh + v{h, u — Q, T)dh. 



(85) 



Therefore, m'^ ~ 0{1/\'N), > 2 is expressed as 



i 

1 

N 



^1 = ^E^rer^(^^'^^^-^'^)' 



(86) 
(87) 
(88) 



where 



xi^^ = x{h^\u;,-n,T), 

N 



(89) 



Note that X]-^^ is uncorrected with ^f. We can neglect the complex conjugate term Vi, 



which leads to a higher-harmonic term of the coupling function |2^, since E 
From Eq. (^61), we obtain 

1 



N{1 - e'l^^Ui) 



0. 



(90) 



Substituting Eq. (|90|) into the cross-talk noise of Eq. (83), in the limit N — > oo, we can 
split the cross-talk noise into the Gaussian random variable and the ORT: 

aN 



11=2 



^rrt = zf + 



a 



1 - e*/3of/ 

aN 



1 



E E ff?;-^^ 



U = —^u{hi,Ui-n,T) 



j ' 



(91) 

(92) 
(93) 
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Next, we split the coupling noise term of Eq. (|83D into the Gaussian random variable and 
the ORT. 

N N 

+ Sie"'''U2 + Sie-'^'^V2, (94) 
1 ^ 

t/2 = — ^ 6nij6njiu{hf\ujj - fi, r), (95) 



V2 = — ^ 6nij6njiv{hf ,ujj - Q,t), (96) 



where 



N 



J^)^-^Po ^ ^u^u ^ ^ ^^^^^^ _ ^^^^ (97) 

Note that Xp'' is uncorrelated with briij. We can also neglect the complex conjugate term V2, 



which leads to a higher-harmonic term of the coupling function since E[5nij5nji\ = 0. 
For the symmetric diluted system, E[5nij5nji] = so, in the limit X ^ 00, we can split 
the coupling noise term of Eq. ( p3|) into the Gaussian random variable and the ORT: 

N 

^SriijSj = zf + 2u'^e'^''Usi, (98) 

N 



^^vXf (99) 

1 ^ 

For the asymmetric diluted system, we can neglect the ORT in the coupling noise term: 

(101) 

_ _ (102) 
since E[6nij6nji] = 0. 



N 






= z'^ 








N 
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From these manipulations, local field hi is given by 



/i-e"^* = ^Im^ + zf + zf + Vsi (103) 
r = ^ — + 2z/2e**f/ (symmetric), (104) 



where 2;^^ + zf is a random variable of an isotropic 2-dimensional Gaussian that satisfies 

E[Re[zt + zff] = E[lm[zf + zrr] 



a 



2|1 -e^*t/|2 



+ z/ 



2 



5 



i?[Re[^,^ + zf]ImK^ + ^f]] = 0, 



In the final step of SCSNA, we determine a pure effective local field hi in a self-consistent 
manner. We present Eq. ( ^7D again: 

— + cuj — = sin 0i/if — cos (106) 

On the other hand, local field hi is given by 

h^e-'^'' = i]m^ + zf + + |r| exp(i^/')si, (107) 
= Arg(r). (108) 

Substituting Eq. ( [T07|) into Eq. (H), we obtain 



sin0, (Re[e^*(e>' + + zf)] + |r| cos(0i + ^ + /?o)) 

- cos 0i (Im[e'* {i}m} + + )] + |r| sin(0i + ^ + /?o)) 
sin0iRe[e'*(e-m' + zf + zf )] 

- cos0Jm[e^^«(e-m^ + zf + zf )] - |r| sin(^ + /3o). (109) 
Comparing Eq. ( p.06|) with Eq. ( [L09|) , we can determine effective local field hi: 

ke-'^" = ^Im^ + zf + zf , (110) 
and we can obtain Cl, which is the renormalized version of Q: 

n = n-\T\sm{ij + (3o). (Ill) 



d(pi 

— \- UJi — \ l 

dr 
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These final two results are consistent with the first assumption for a pure effective local field 
hi in Eq. (|6|). 

Finally, we combine the results obtained from SK theory and SCSNA. We can safely 
replace X{hi, uji — Vt, r) of order parameters and U with Eq. ( |STD based on hi. 

= ^^tiX{hi,uJi-n,T) 

i 

= (112) 

i 

TT _ ]_sr^ dX{hi,uJi - Q,t) 
~ dhi 

. d(si{hi)) 

= T^y ~ s (113) 

dhi 

ke-'^" = ilrn^ + zf + zf , (114) 

because hi is independent of any microscopic configuration of unit i. In conclusion, we can 
obtain the order parameter equations ( ^4]) and (|55D. In this way, our derivation process is 
complete in a self-consistent manner. 
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